DOCUMENT RESUME 

ED 319 194 EC 230 883 



AUTHOR 
TITLE 

INSTITUTION 

SPONS AGENCY 

PUB DATE 

GRANT 

NOTE 

AVAILABLE FROM 



PUB TYPE 



Bolton, Brian; Roessler, Richard 

Manual for the Work Personality Profile. 

Arkansas Univ., Fayetteville. Research and Training 

Center in Vocational Rehabilitation. 

National Inst, of Handicapped Research (ED), 

Washington, DC. 

Dec 86 

G0083C0010/04 

43p.; For related documents, see EC 230 884-887. 
Arkansas Research and Training Center in Vocational 
Rehabilitation, Publications Dept., P.O. Box 1358, 
Hot Sprinjs, AR 71902 ($5.00). 
Tests/Evaluation Instruments (150) — Reports - 
Research/Technical (143) 



EDRS PRICE 
DESCRIPTORS 



MF01/PC02 Plus Postage. 

Adults; *Behavior Rating Scales; Diagnostic Tests; 
^Disabilities; ^Occupational Tests; Test Reliability; 
Test Validity; * Vocational Evaluation 



ABSTRACT 

The manual introduces the Work Personality Profile 
(WPP) , an observational work behavior rating inst rument for use in 
situational assessment in work centers, comprehensive facilities, and 
employment settings. The WPP assesses such abilities as work 
attitudes, values, habits, and behaviors that are essential to 
achievement and maintenance of employment. It consists of 58 items 
that are completed by vocational evaluators using a standard 4-point 
scale. The WPP can serve as a basis for the assignment of clients to 
remedial programming and the measurement of improvement in targeted 
behaviors at regular intervals. The manual de-=^cribes development of 
the WPP, its reliability and validity, and its applications. The 
manual includes the instrument, scoring key, profile report form, 
normative table, directions for administration and scoring, and 16 
references. It also includes instructions for using the 
IBK-compatible floppy disk format of the WPP, which generates the 
score profile directly from ratings on the 58 items. Contains 15 
references. (JDD) 



* Reproductions supplied by EDRS are the best that can be made 

* from the original docuirent. 




> Brian Bolton ^ 
\ftichard Roessler 



Hr-i^t^nsos Rcscorch 6» TrointnQ Center in Vocotfonol Rchobilitotion 

Univcrsiti^ of fTrkonso^, FoyettcviMe 
RrV^onsos RchobihtotJOO Services 



5 





U.S. DEPARTMENT OF EDUCATION 

OHice o* Educahonai Research «nd Improvement 

EDUCAneNAL RESOURCES INFORMATION 
CENTER (ERIC) 

&nt\ii document has been reproduced as 
received from the person or organization 
originating it 

O Minor changes have been made to improve 

rfc, rodUCtlOn QUfllit ' 

Points M view or opinions Slated m this docu* 
ment not necessarily represent oHic<a> 
OERI podttio or poi<cy 



ork Personcilitv 

ii>ROFIL€ 




ERIC 



2 



Put)l^s^ecJ By 



ArkonsQS Aessorch 6 Training Center 
in VocQtionol AehobllltcUon 



Dosjqn & P»oOu<tion 

M< Jio ^^teriols Oevelopfnent & Dtssemlnotion Unit 



The content s of this publication u;erc developed under q research and troinlng center grant (GO083C00 10/04) from the 
Nationol institute of Ha'^x^icopped Research Office of Special €ducotlon and ftehabllltotlve Services; Deportment of €ducatlon. 
LUashlrigtoa D C. 2020!?. Houiever. these co ntents do not necessonty represent the policy of thot ogency. ond vou should not 
ossume erKJorsemer.t bv the f^<jeTc\\ Government. 

f^ll programs odmlnlstered by and service?, provided bv the f^rkansos Research and Training Center in Vocotlortcl f^ehobilitatlon 
are rendered on a rondiscrimiACtarv bosls mithaut regord to handlcop. race, creed, color, sex, or notional origin In compllonce mlth 
the f^ehabilltatlon f^ct of 1 964 f^ll oppliconts for program portlclpotion and/or services have a right to file complaints and toappeal 
CKCOfdlng to reguloUons governing this principle. 



3 



AAanual for the 

Work Personality Profile 



Brian Boiton 
Richard Foessler 



December, 1986 



flriionsos fleseorch and Training Center In Vocctlor.Ql Rehabilitation 
University of Brkonsos, foyetteville 
RrlfonsQs Rehobllltotlon Services 



ERIC 



4 



Overview 



***The Work Personality Profile (WPP) is a work behavior 
rating instrument for use in situational assessment in 
work centers, comprehensive facilities, and employment 
settings. 

***The WPP assfcsses those capabilities that satisfy fun- 
damental work role requirements, i.e... work attitudes, 
values, habits, and behaviors that are essential to 
achievement and maintenance of suitable employment. 

***The WPP possesses the advantages of comprehensive 

coverage, behavioral orientation, diagnostic function, 
and direct rating format. 

***The WPP consists of 58 items that are completed by voca- 
tional evaluators using a standard 4-point scale. It 
requires 5-10 minutes to complete following an obser- 
vation period of one week. 

***The WPP can serve as a basis for (a) the assignment of 
clients to remedial programming and (b) the measurement 
of improvement in targeted behaviors at regular intervals. 

***WPP results are reported on a profile form ' at includes 
11 primary work behavior categories and 5 second-order 
factor scales. Both raw scores and normative oercentile 
scores are reported. 

***The WPP instrument, scoring key, profile report form, 
normative table, and directions for administration and 
scoring, as well as reliability and validity evidence, 
are contained in the WPP Manual . 

***The WPP is also available on a floppy disk that generates 
the score profile directly from ratings on the 58 items. 
Written in BASIC for MS DOS machines, the WPP will run on 
most IBM compatible machines. 
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Manual for the Work Personality Profile 

Introduction 

Particularly appropriate for evaluating general 
employability , situational assessment is widely used in 
workshop and facility settings (Dunn, 1973). Specifically, 
situational assessments yield a realistic sample of the 
individual's responses to a wide variety of stimuli relevant 
to task performance and interpersonal relationship demands 
on the job (Hoffman, 1972). A recent survey of employers 
underscored the importance of interpersonal task performance 
and teamwork skills for an employee's tenure on the job 
(Selz, Jones, & Ashley, 1980). Support for the validity of 
this employer opinion can also be found in numerous studies 
of the success of rehabilitation clients in maintaining work 
(Greenspan & Shoultz, 1981; Kolstoe, 1961; Lewinsohn & Graf, 
1973). 

Rehabilitation clients must, therefore, either possess 
job maintenance skills upon entering services or develop 
them as a result of work adjustment interventions. As 
Getting and Miller (1977) noted, absence of on-the-job 
adjustment skills "leads to being fired or to the kind of 
criticism that makes a person quit" (p. 34). To determine 
whether a person possesses job maintenance skills, an 
assessment instrument is needed. Therefore, the authors 
conducted an extensive study of instrumentation designed to 
measure vocational functioning to isolate those skills 
central to meeting the demands of the work role or main- 
taining one's job (Roessler & Bolton, 1983). The instrument 
that resulted is the Work Personality profile (WPP), 

The major reason for developing the Work Personality 
Profile (WPP) was to make available for research and service 
applications a comprehensive observational instrument for 
assessing critical work role requirements. Previously 
discussed in detail (Roessler & Bolton, 1983), these work 
role requirements represent specific job maintenance tasks. 
As a result of sorting the items and scales of 10 relevant 
vocational functioning measures, a composite measure 
emerged, the WPP, representing a comprehensive sample of job 
maintenance behaviors. Use of the WPP, therefore, iden- 
tifies deficiencies, that if not remediated, may prevent a 
disabled client from achieving or maintaining employment. 

It was also felt that an efficient approach to job 
maintenance assessment was needed. Tb'? 58 behavioral itei ^ 
on the WPP can be rated in approximately 5 to 10 minutes. 
The scaling enables the evaluator to specify whether the 
particular target behavior represents an employability 
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strength or weakness. Hence, in only a few minutes time- 
the evaluator can produce a profile of the client's job 
maintenance liabilities and assets. 

Finally, the WPP is intended to represent meanin^rful 
employability constructs, i.e. , those behaviors direct'.y 
relevant to employment: success and, therefore, to work 
adjustment planning. Employability strengths as identified 
by the WPP suggest possibl3 areas to consider in terms of 
job/person match. In other words, individuals with certain 
types of strengths would do particularly well on jobs 
requiring those capabilities. On the other hand, employabi- 
lity deficits suggest areas for skill development to improve 
the person's chances to retain a job r,nd, possibly, to 
advance on the job. Therefore, the counselor should utilize 
information on employability strengths as well as deficits 
in work adjustment counseling with clients. 

The WPP 

The Work Personality Profile (WPP) is an observational 
rating instrument designed for use in situational assessment 
in work centers and comprehensive facility settings (see 
enclosed WPP). The WPP consists of 58 behaviorally-oriented 
items that are rated by vocational evaluators using a stan- 
dard 4-point scale. WPP ratings represent judgments of 
employability strengths and deficits that reflect an indivi- 
dual's funct oning level on 11 rationally derived categories 
of work performance and five factor analytically developed 
scales. 

Resulting from an item-by-item analysis of 10 well 
known work assessment instruments, the 58 WPP items encom- 
pass the domain of vocational functioning known as the work 
personality (Roessler & Bolton, 1983). The work personality 
consists of those capabilities that satisfy fundamental work 
role requirements, i.e. , work attitudes, values, habits, and 
behaviors that are essential to achievement and maintenance 
of suitable employment. An aspect of the work personality 
critical to development and application of the WPP is the 
recognition that work personality elements are modifiable, 
j- »e' / appropriate work attitudes, values, and behaviors can 
be acquired. Hence, vocational diagnosis with the WPP 
establishes a quantitative basis for implementation of 
interventions designed to enhance employability of han- 
dicapped clients (see Marr & Roessler, 1986). 

The WPP possesses the advantages of comprehensive 
coverage, behavioral orientation, diagnostic function, and 
direct rating format. Factors such as test anxiety, social 
desirability, and/or frustration with the measurement task 
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have little or no effect on WPP ratings. The ratings repre- 
sent judgmerts regarding employability strengths and defi- 
cits on 16 dimensions of work performance (see Table 1). 
The results of the evaluator's ratings are summarized on a 
profile form (see page 6) that graphically portrays the 
client's work personality strengths and deficits. These 
data can serve as a basis for (a) the development and 
assignment of clients to remedial programming and (b) the 
mf^asurement of improvement in targeted work behaviors by 
completing the WPP at regular intervals. 

The profile report form is used to summarize WPP 
results on the 16 work performance scales. The profile 
sheet also provides space for the evaluator to enumerate 
critical skill deficiencies. The WPP should be administered 
after the client has completed one week (between 20 and 30 
hours) in the vocational evaluation setting. This amount of 
time will usually ensure adequate opportunities for careful 
observation and planned interaction with the client. 
Ratings on the 58 behavioral items are scored on the 16 sca- 
les by summing the keyed items and dividing by the number of 
items completed (i . e. ^ disregard items that are rated "X"). 
The key for scoring the WPP items on the 16 scales is given 
in Appendix 2. 

WPP scale scores can also be evaluated in relation to 
norms on a large group of disabled person'-j in rehabilitation 
facilities. Representative of handicapped persons who 
receive work evaluation services in rehabilitation work 'ten- 
ters and comprehensive facilities, the normative sample 
(N=243) provides an excellent basis for calculation of stan- 
dard scores. For certain diagnostic applications, average 
raw scale scores are most useful because they locate clients 
on the 4-po\nt anchored format, i .e. , they have direct 
criterion-referenced meaning. But, a score profile that 
indicates a client's work status . lacive to a represen- 
tative population of clients is r<fLen useful, too. 
Therefore, score distributions for the 11 rational and five 
factor scales for the normative sample are given in Appendix 
3. The tabled distribv ns enable evaluatcrs to translate 
raw (average) scores in-i decile or percentile equivalents. 
Scale scoring equations and normative translations have been 
programmed for microcomputer, greatly facilitating the 
scoring and reporting of WPP profiles (see Appendix 4 for an 
example of a scored Wpp with accompanying Profile Report). 
The computer diskette (IBM-PC compatible) is available from 
the RT Center. Facilities that do not have desk computers 
are encouraged to photocopy the V/PP as needed. Preprinted 
WPPs are also available from thr KT Center. 



ERIC 



3 

10 



Table 1 
WPP Scoring Scales 



Rationally Derived Scale s 

51. Acceptance of the woric role - ability to conforir to 
basic expectations in work, e.g., arrives appropriately 
dressed and accepts work assignments. 

52. Ability to profit from instruction or correction - 
capability to make recommended changes in work beha- 
viors, e.g., listens to instructions or corrections 
attentively and maintains improved work procedures 
after correction, 

53. Work persistence - ability to stay on task without 
prompting, e-g, works steadily during entire work 
period and works at routine jobs without resistance. 

54. Work tolerance - willingness to accept change without 
decreasing effort, e.g., accepts change in wrrk assign- 
ments and maintains productivity despite change in 
routine. 

55. Amount of supeivision required - ability to work with 
minimal supervision and direction, e.g., needs vir- 
tually no direct supervision and recognizes own mistakes. 

56. Extent trainee seeks assistance from supervisor - abi- 
lity to ask for supervisory help appropriately, e.g., 
asks for further instructions if task is not clear and 
requests help in an appropriate fashion. 

57. Degree of comfort or anxiety with supervisor - ability 
to interact with supervisor without anxiety, e.g., 
approaches supervisory personnel with confidence and 
performance remains stable in supervisor's presence. 

58. Appropriateness of personal relations with supervisor - 
ability to interact pleasantly and appropriately on the 
job, e.g., discusses personal problems with supervisor 
only if work-related and gets along with staff, 

59. Teamwork - ability to work cooperatively, e.g., accepts 
assignment to teamwork tasks and works comfortably in 
group tasks. 




510, Ability to socialize with co-workers - capability to 
establish friendships with co-workers, e.g., shows 
interest in what others are doing and appears comfor- 
table in social interactions, 

511. Social communication skills - ability to express one- 
self in social interactions, e.g., expresses likes and 
dislikes appropriately and initiates conversations with 
others. 

Factor Analytic Scales 



Fl, Task orientation - ability to demonstrate sound cogni- 
tive skills and work habits on the job, e.g., learns 
quickly, initiates activity, and performs indepen- 
dently, 

F2, Social skills - ability to relate to co-workers, e.g., 
friendly, sociable, works well with others. 

F3. Work motivation - ability to accept routine assignments 
and respond to change, e.g*, willingly accepts work 
assignments and moves readily to new tasks, 

F4. Work conformance - ability to adapt to work role 

requirements and to control self-expression, e.g., con- 
forms to rules and regulations and displays good 
judgment in use of obscenities and vulgarities, 

F5. Personal presentation - ability to respond 

appropriately to authority figures, e.g., sufficiently 
alert and aware and requests help in an appropriate 
fashion. 



WPP Applications 

There are a number of uses for the WPP. First, it pro- 
vides the data necessary to develop an individual's profile 
on 16 essential dimensions of work performance. Results at 
this profile level are useful in the early stages of work 
adjustment planning, in Social Security evaluations, and in 
short-term work evaluations done for VR counselors. 

The WPP profile sheet also lists those behaviors for 
which the trainee received a rating of either 1 (a problem 
area, will definitely limit the person's chances for 
employment) or 2 (performance inconsistent, potential 
employability problem). These deficits in fundamental work 
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capabilities must be addressed in the person's work adjust- 
ment plan. Hence, they represent adjustment, rehabilita- 
tion, or h-ibilitation objectives for the individualized 
service program. These program objectives dictate the type 
of employability interventions to select. 

Evaluators and counselors can also scan the actual 
rating form to identify particular employability strengths 
(a rating of 4^) or areas of adequate performance (a rating 
of 3). Employability strengths or adequacies should be con- 
sidered when estimating job/person match in particular jobs 
in specific companies. 

Development of the WPP 

The WPP was constructed to operationalize the concept 
of the functional vocational capabilities (FVC's) required 
by the work role, a concept derived from the early writings 
of Gellman (1953) and referred to hereafter as the work per- 
sonality (see Figure 2 in Roessler & Bolton, 1983). 
Functional Vocational Capabilities (FVC's) include those 
behaviors, skills, or attitudes needed for success in work. 
To sample these constructs and to insure comprehensive 
coverage of the work personality, the authors defined the 
domain of FVC's as the behaviors included in 10 well-known 
work assessment instruments (see Figure 3 in Roessler & 
Bolton, 1983, numbers 1, 2, 3, 7, 9, 10, 11, 12, 13, & 15). 

After all items relating to work establishment (Crites, 
1976) in the 10 instruments were typed on individual cards, 
a sorting procedure began that extended over several days; 
the objective was to put similar items together and thereby 
identify clusters or subscales of FVC's. The initial 
sorting procedure generated a tentative set of 16 rationally 
derived clusters, which was progressively refined by 
deleting redundant items and merging similar clusters; the 
process could be described as an iterative clustering 
algorithm based on the authors' expert judgments of the 
nature of the behavior, skill, or attitude assessed by the 
original items. 

The first WPP version to result from this progressive 
refining and merging process was a set of 64 beha^iorally- 
oriented items written in standard format and organized into 
11 homogeneous clusters of work personality attributes. 
This first edition of the WPP required two types of 
judgments by the evaluator: (a) binary (yes/nc) ratings on 
each item and (b) global 3-point judgments on each of the 11 
dimensions. Based on the results of a pilot administration 
including feedback from four vocational evaluators and the 
results of preliminary statistical analyses, the following 



modif .'cations were made; 



1. The item response format was changed from Y/N to a 
4-point scale ranging from employability deficit 
(1) to employability strength (4) to provide more 
precision in the diagnosis of work personality 
attributes. 

2. Several items that referred to behaviors or attitu- 
des that evaluators had little opportunity to 
observe were deleted. 

3. A few items that referred to multiple target beha- 
viors were rewritten or divided into two items. 

4. All negatively stated items were changed to posi- 
tive phrasing. 

The second edition of the wr^P, which consisted of 58 
items that were scored on the same 11 dimensions of FVC's, 
was administered to ^7 clients in a comprehensive rehabili- 
tation center; results of the statistical analyses indicated 
that the revised items and the expanded rating format were 
fine, but that the global ratings were not serving a signi- 
ficant purpose. Hence, the third (current) edition of the 
WPP consists of 58 behavioral items arranged in random 
order, each requiring a 4-point judgment from employability 
strength to deficit, that are scored and profiled on 16 
dimensions of the work personality. 

Using the current edition of the WPP, data on two pri- 
mary research samples were collected to analyze reliability 
and validity properties of the instrument (discussed in the 
section to follow). The first samole consists of 243 
clients of three rehabilitation centers offering work eva- 
luation, work adjustment, vocational training, and long-term 
assignments on contract work tasks. The second sample is 
composed of 181 clients of a comprehensive residential reha- 
bilitation center. The first sample is referred to as the 
normative sample and the second as the validitv sample. A 
subsample of 7 9 clients from the normative sample was used 
for the reliability analyses. 

Brief demographic descriptions of the primary samples 
are (with statistics given first for the normative sample): 
proportion male (65%/65%); median age (25 years/23 years), 
age 35 or less (77%/86%); highest grade completed: seventh 
grade (10%/8%), 12 or more grades completed (47%/53%); major 
disabling condition: physical (26%/45%), intellectual 
(31%/24%), emotional (43%/31%). The major research samples 
are heterogeneous with respect to demographic composition 
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and roughly comparable, as are the reliability and validity 
subsamples used in later analyses. 

For the purpose of identifying the "^syohometric dimen- 
sions of work behavior encompassed by the WPP, a factor ana- 
lysis of the 58 items was conducted for the normative sample 
of 243 clients. A principal components condensation 
followed by Varimax rotation isolated five factors that 
explain the majority of item covariation on the WPP. Items 
were assigned to the factors on which they had their highest 
loadings; these five subsets of items constitute scoreable 
subscales. Factor scale scores were subsequently calculated 
by summing (unit-weighting) the items composing each scale. 

The first factor scale consists of 21 items repre- 
senting six of the 11 rationally derived WPP scales. 
Apnendix 2 lists the items composing the factor scales. 
Examination of the 21 items reveals ^hat this is a dimension 
of work performance that enconpasses both cognitive skills 
and good work habits. A highly rated client learns quickly, 
initiates activity, perfoims independently, and asks 
questions only when necessary. Adaptable and responsible, 
this client also possesses good learning ability on the job, 
with capacity for self direction, in summary, the first fac- 
tor scale enumerates attributes of a mature worker and can 
be reasonably labeled Task Orientation . 

The second factor scale contains 12 items from four WPP 
rational scales. Th ^ content of the items suggests a dimen- 
sion of work behavior reflective of a -ociable, outgoing, 
friendly, emotionally expressive temperamental inclination. 
The client who scores higher on this scale interacts well 
with others, enjoys working with others, and is helpful, 
supportive, and socially responsive in the work setting. In 
summary, the second factor scale identifies individuals who 
interact appropriately with co-workers and raay be called 
Social Skills . 

The third factor scale consists of eight items from 
four WPP rational scales. This dimension describes an indi- 
vidual who willingly accepts work assignments, moves readily 
to new tasks, and works at routine jobs without complaininc. 
This client also works well in group situations. The work" 
attitude displayed is one of flexibility, acceptance, 
compliance, and responsivity to authority. Because these 
characteristics describe a properly motivated employee, this 
factor is named Work Motivation . 

The fourth factor scale is scored on nine items, seven 
of which represent just two of the rational scales of the 
WPP. This dimension is concerned generally with appropriate 
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behavior in the work setting. Specifically, five items 
refer to exercise of good judgment in the expression of 

' hrMTon^^ ^^^"'^ "^^y ^^^y ^ell indicate that 

.he client simply refrains from expressions of negative 

tharnf-n ""^^^^ dominant theme in this dimension Is 
lumL^i -"^^^"7 tempered, controlled self-presentation, in 
?n^?J« ?A ""^^ °" this dimension con- 

it^nLl^ understood rules of work 

etiquette, justifying the name Work Conformance . 

The fifth factor scale consists of eight items that 
represent four WPP rational scales. The underlying dimen- 
if.r!^®"?^ the item content is focused on the 
client's skill in interacting with supervisory personnel ^n 
the work setting, including attention to personal hygiene 
and appearance. Recognizing that the dominant theme 
f?af?iof lu^ ability to respond appropriately to authority 
figures, this scale may be labelled Personal Presentation . 

Two other factor analytic studies of handicapped per- 
sons' rated work behavior have been reported in the litera- 
ture. Gellman, Stern, and Soloff (1963) identified five 
5?i:'t°".in the Workshop Scale of Employabili ty (WSE): 
Attitudinal Conformity to Work Role, Maintenance of Quality, 
Acceptance of Work Demands, Interpersonal Security, and 
Productivity. Factor analysis of the Minnesota 
Satisfactoriness Scales (MSS) resulted in four factors 
(Bolton, 1985b): Performance, Conformance, Personal 
Adjustment, and Dependability. 

Many of the 52 items composing the WSE reflect a 
psychodynamic orientation, in contrast to the WPP, which 



much more behaviorally-oriented. The 28 MSS items emphasize 
performance characteristics associated with successful 
employment. The MSS is typically completed by supervisors 
of employed former VR clients, while the WSE and WPP were 
both designed to enhance the diagnostic function in simu- 
lated, therapei'tic work settings. Furthermore, the MSS uses 
a comparative rating format, in contrast to the WSE and WPP 
which require judgments on anchored scales. 

Consequently, it should not be surprising that careful 
examination of the factor constructs embodied in the WSE 
(see Bolton, 1970, pp 4-5) and in the MSS (see Gibson, 
Weiss, Dawis, & Lofquist, 1970, pp. 20-21) revealed that 
from^t-^^''^S^ resolutions were different from each other and 
from the WPP yet, it can be reasonably concluded— as 
explained below—that the WPP factor scales provide the most 
useful score profile for diagnostic purposes in work eva- 
luation settings. 
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Overall, the WPP factor structure consists of one 
general work pprformance dimension and four fairly narrow 
behavioral clusters, focusing on interaction with co- 
workers, appropriate motivational attitudes, conformance to 
rules, and rej^ponsiveness to supervisors. Each of these 
factors has considerable historical precedent in the work 
assessment literature.' Although individually meaningful and 
coherent when taken as a set, the factor scales do not align 
perfectly with the rational scales. 

Lack of similarity between rational and empirical fac- 
tors is common. Empirically based rating factors represent 
observers' perceptual structures or implicit personality 
theories (Passini & Norman, 1966) to a substantial degree, 
i»e» / observers impose their common perceptual framework 
through their ratings. In contrast, the 11 rational scales 
represent categories of work behavior that make a priori 
organizational sense. Hence, it can be reasonably concluded 
that the two scoring schemes are complementary, each pro- 
viding relevant diagnostic information, but at different 
levels of behavioral organisation. 

Because the factor scales are scored by summing raw 
item scores (and then dividing by the number of items), the 
factor scores are necessarily moderately intercorrelated. 
The median interf actor scale correlation is .56, with a 
range from .38 to .69, in the normative sample. (Comparable 
figures for the 11 rational scales are .62 and .31 to .84.) 
These data indicate that the factor scales share some common 
variance, typically 25% to 35%, but that they are substan- 
tially independent and therefore give work evaluators infor- 
mation about liive clearly separable aspects of clients' work 
behavior . 

Results of WPP research, therefore, indicate that the 
WPP consists of 11 rationally constructed work performance 
scales and five factor analytically derived scales. The 16 
WPP scales were previously listed and described in Table 1. 
Descriptive statistics from the normative sample for the 16 
WPP scales are provided in Table 2. It is apparent from ♦he 
scale means and standard deviations that the score distribu- 
tions are negatively skewed, indicating that more efficient 
diagnostic discrimination occurs at the lower (deficit) end 
of the scales, which is exactly what is desired. All WPPs 
were completed by trained rehabilitation professionals after 
clients had been observed for at least one week in a simu- 
lated work setting. 

Reliability and Validity 

Reliability . Three types of reliability evidence are 
available for the WPP, internal consistency, inter-rater 
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Table 2 

WPP Descriptive Statistics Calculated 
for the Normative Sample (N = 243)^ 





Scale 


Items 


M 




SD 


a 


SI. 


Acceptance of Work Role 


10 


3.16 


0 


.55 


.84 


o 


ADiiiuy uo ?rorit rrom 
Instruction or Correction 


6 


2.99 


0 


.59 


.91 


e o 
S J . 


Work Persistence 


4 


2.89 


0 


.67 


.81 


S4. 


Work Tolerance 


5 


2.95 


0 


.66 


.87 


S5. 


Amount of Supervision Required 


6 


2.78 


0 


.74 


.92 


S6. 


Extent Trainee Seeks Ass.idtance 
from Supervisor 


3 


2.90 


0 


.67 


.83 


S7. 


Degree of Comforn or Anxiety 
with Supervisor 


4 


2.97 


0 


.53 


. 71 


S8. 


Appropriateness of Personal 
Relations with Supervisor 


3 


3.06 


0 


.63 


.75 


S3 • 


Teamwork 


6 


2. 87 


0 


.58 


.86 


810 . 


Ability to Socialize with 
Co-workers 


5 


2.61 


0 


. /6 


.91 


Sll. 


Social Communication Skills 


6 


2.80 


0 


.58 


.80 


I. 


Task Orientation 


21 


2.87 


0 


.62 


.89 


II. 


Social Skills 


12 


2.74 


0, 


.67 


.83 


III. 


Work Motivation 


8 


3.11 


0, 


.63 


.91 


IV. 


Work Conformance 


9 


2.98 


0, 


.64 


.90 


V. 


Personal Presentation 


8 


3.09 


0, 


.52 


.84 



^Means (M) and Standard Deviations (SD) are average item raw 
scores on the 4-point scale ranging from "an employability 
asset" (4) to "a problem area" (1). 




agreement, and re-rating accuracy. Internal consistency 
reliabilities (coefficient alpha) for the 11 rational scales 
and five factor scales were calculated for the normative 
sample of 243 clients. Inter-rater and re-rating reliabili- 
ties were calculated for a sample of 79 clients from one of 
the three normative data collection sites. 

Internal consistency reliability estimates for the 11 
rational scales mnge from .71 to .92, with a median value 
of .84. For the tive factor scales the reliabilities range 
from .83 to .91, with a median of .89 (see Table 2 for 
actual values). Recognizing that internal consistency coef- 
ficients establish lower limits for retest reliabilities, 
these estimates are well within the acceptable range. 
However, it is important to stress that internal consistency 
reliability bears no direct relationship to inter-rater 
agreement, unless certain (unwarranted) simplifying assump- 
tions are made. 

The research design for determining inter-rater and re- 
rater reliability entailed the completion of the WPP by two 
judges (independently) at the end of the second, fourth, and 
sixth weeks in the work evaluation program. The ratings 
were made by rehabilitation counselors, work evaluators, or 
behavioral analysts. Due to normal attrition from/and 
completion of /the work evaluation process, the sample was 
reduced to 61 clients after four weeks and to 25 clients 
after six weeks. Examination of mean ratings for the suc- 
cessively reduced samples revealed no evidence of increasing 
client difficulty, i.e. , the ratings were not lower at the 
fourth and sixth weeks. 

Table 3 presents the inter-rater and re-rating reliabi- 
lities. For ratings completed at the end of two weeks (n - 
79), the inter-rater reliabilities for the 11 rational WPP 
scales ranged from .17 to .60, with a median of .48. 
Corresponding coefficients for the five factor scales were 
.44 to .62, with a median of .56. Reliabilities for the 
ratings after four (n = 61) and six (n = 25) weeks, respec- 
tively, for the 11 rational scales ranged from .35 to .76, 
with a median of .55, and from .23 to .86, with a median of 
.62. Parallel coefficients for the five factor scales were 
.40 to .76, with a median of .58, and .35 to .81 with a 
median of .66, respectively. These ranges for inter-rater 
reliabilities are consistent with those reported for the 
Workshop Scale of Employability (Gellman, Stern, & Soloff, 
1963). As was found with the WSE, WPP inter-rater reliabi- 
lities would no doubt be increased if clients experiencing 
changes in supervision or work conditions were eliminated 
from the reliability sample. 
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Table 3 

Relidbilit' stimates for the WPP^ 



Interrater Reliability Re-rater Reliability ^ 



Scale 


Wk2 


Wk4 


Wk6 


2-4 


4-6 


2-6 


SI 


.60 


.69 


.63 


.90 


.79 


.93 


S2 


.39 


.58 


.71 


.85 


.75 


.94 


S3 


.60 


.76 


.62 


.89 


.80 


.92 


S4 


.55 


.55 


.66 


.86 


.83 


.94 


S5 


.50 


.73 


-86 


.84 


.86 


.97 


S6 


.17 


.35 


.42 


.76 


.64 


.89 


S7 


.47 


.56 


.62 


.84 


.80 


.95 


88 


.50 


.53 


.68 


.83 


.77 


.89 


S9 


.26 


.43 


.22 


.81 


.74 


.90 


SIO 


.48 


.42 


.47 


.89 


.67 


.87 


Sll 


.32 


.35 


.26 


.79 


.76 


.89 


I. 


.57 


.76 


.81 


.89 


.85 


.97 


II. 


.44 


.40 


.35 


.86 


.69 


.89 


III. 


.53 


.50 


.65 


.87 


.80 


.96 


IV. 


.62 


.60 


.67 


.84 


.74 


.93 


V. 


.60 


.58 


.66 


.88 


.82 


.93 



^All coefficients are product-moment correlations 
^Averages of two sets of raters 
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These data indicate that independent raters, even when 
highly qualified to observe and evaluate clients' work beha- 
vior, do not agree very much with each other. This finding 
is not unique to the WPP, but rather seems to reflect the 
idiosyncratic nature of the work evaluation process. 
Although vocational evaluators oftentimes do not agree with 
each other, the data on re- rating which is summarized next 
suggest that they are highly consistent in applying their 
own standards. 

If a more reliable composite based on the ratings of 
independent observers is desired, the solution is to average 
the ratings of 2, 3, or even 4 evaluators. This is analo- 
gous to doubling, tripling, or quadrupling the length of a 
test with the consequent gain in reliability. Because the 
WPP may be completed so quickly and easily, this is an eco- 
nomical resolution of the problem of low inter-rater 
reliability. For work adjustment purposes, evaluators may 
also present any deficit reported by any rater as a valid 
intervention target. 

As suggested already and documented in Table 3, the re- 
rating reliablity estimates are generally very high, 
suggesting that evaluators use the WPP in a consistent 
manner from day to day and week to week. The re-rating 
reliabilities from week 2 to week 4 ( n = 61 ) for the 11 
rational scales ranged from .76 to .90, with a median value 
of .84. Corresponding reliabilities for the factor scales 
were .84 to .89, with a median of .87. Reliabilities for 
the re-ratings from week 4 to week 6 ( n = 25 ) and from week 
2 to week 6 (n « 25 ) respectively, for the rational scales 
ranged from .64 to .86, with a median of .77, and from .87 
to .97, with a median of .92. Parallel coefficients for the 
factor scales were .69 to .85, with a median of .80, and .89 
to .97 with a median of .93, respectively. The 
inter-rater/intra-rater reliability differential found with 
the WPP was also reported for the WSE (Gellman, Stern, & 
Soloff, 1963). 

In addition to the conclusions stated previously about 
low inter-rater agreement with the WPP and high intra-ratf^r 
reliability on re-rating, it can be observed that rationa 
scales S6, S9, and Sll, and factor scale F2 are less 
reliable than other scales. The results suggest that 
clients' interpersonal behaviors, especially when 
interacting with co-workers, are subject to individual 
raters' interpretation and/or temporal situational fluc- 
tuation. In summary, it can be concluded that the WPP 
possesses adequate reliability for diagnostic applications 
in work evaluation programs. This conclusion presumes that 
two or more independent ratings are averaged into a com- 
posite profile for each client evaluated, 
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Validity . Two types of validity evidence are available 
for the WPP (Bolton, 1985a). Concurrent correlations wilth 
standardized measures of vocational aptitudes, occupational 
interests, and normal personality traits are presented. 
Predictive validity against two criteria, type of service 
outcome and ratings by vocational instructors, is 
demonstrated. 

As c ascribed earlier, the validity sample consisted of 
181 clients at a comprehensive rehabilitation center. Due 
to limited opportunity to observe clients in group interac- 
tion, the WPP was reduced to 38 items that are scored on the 
first eight rational scales for the validity study. Scale 
means and standard deviations for SI through S8 were similar 
to the normative sample with alpha reliabilities in the 
range .85 to .95; however, the average inter-scale correla- 
tion was .78, suggesting a large general factor und,irlying ^ 
the WPP ratings for the validity sample. 

Concurrent correlations be tween\ eight WPP scales and 
nine aptitudes measured by the General Aptitude Test Battery 
(GATE), 12 interest areas measured by the United State 
Employment Service Interest Inventory (USES-II), and 16 per- 
sonality traits assessed by the Sixteen Personality Factor 
Questionnaire (16 PF) are listed in Table 4. It can be 
observed that the WPP has substantial relationships with 
cognitive aptitudes (G, V, N) , lower correlations with per- 
ceptual aptitudes (S, P, Q), and minimal relationships with 
psychomotor aptitudes (K, F, M) . Although the high WPP 
inter-scale correlations preclude much differentiation, it 
appears that S2-Ability to Profit from Instruction or 
Correction and S5-Amount of Supervision Required most 
strongly reflect vocational aptitude. In general, the 
WPP-aptitude correlations were substantially higher for 
females, especially for aptitudes G, V, N, and Q. 

Surprisingly, several occupational interest scales are 
related to observer-rated work behavior. The positive WPP 
relationships with Scientific and Mechanical interests are 
determined mainly by males in the sample. In contrast, the 
positive WPP relationships with Business and Leadership 
interests and the negative relationship with Service 
interests reflect mostly the influence of the female sub- 
sample. In fact, the validity coefficients for the females 
for these scales and Outdoor interests (negative) are in the 
.30s and .40s. Negative relationships between rated work 
behavior and interest in Service and Outdoor occupations 
suggest that clients attracted to low-level jobs are less 
well prepared to meet essential requirements of the work 
role. 
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Table 4 

WPP Correlations wi\:h Aptitudes, Interests, and Personality^ 



WPP Scales 



GATE 


SI 


S2 


S3 


S4 


S5 


S6 


S7 


S8 


G-General 


.27*** 


.41*** 


.35*** 


.32*** 


.41*** 


.29*** 


.25** 


.17* 


V- Verbal 


.25** 


.33*** 


.28*** 


.27*** 


.33*** 


.27*** 


.22** 


.17* 


N- Numerical 


.29*** 


.45*** 


.37*** 


^37*** 


. 46*** 


.33*** 


.27*** 


.20** 


S-Spatial 


.11 


.30*** 


.23** 


. 18* 


.31*** 


.15 


.12 


.08 


P— Per ceo t ion 


.11 


. 22** 


.17* 


. 24** 


.29*** 


.13 


.10 


.06 


Q-Clerical 


.13 


. 27*** 


. 23** 


. 26*** 


.32*** 


.23** 


.11 


.13 


K-Motor 


.11 


. 20* 


.18* 


. 23** 


.23** 


.18* 


.15 


.05 


P-Finger 


.19* 


. 29*** 


.23** 


.23** 


.30*** 


.23** 


.15 


.08 


M- Manual 


.14 


.14 


.12 


.16 


.15 


.15 


.05 


.02 


USES-II 


















1-Artistic 


.05 


.13 


.02 


.01 


.12 


.05 


.06 


.04 


2-Scientif ic 


.10 


.22** 


.16* 


.15 


.19* 


.14 


.21** 


.14 


3-Outdoor 


-.03 


.03 


.00 


.01 


.03 


-.02 


.05 


.09 


4-Protective 


-.05 


-.04 


-.03 


.00 


-.02 


.02 


.05 


.10 


5-Mechanical 


.17* 


. 21 ** 


. 21 ** 


.23** 


. 20* 


.15 


. 23** 


.11 


6-Industrial 


.00 


-.03 


.00 


-.03 


-.02 


.02 


.07 


.05 


7-Business 


.19* 


.17* 


.14 


.17* 


.20* 


.18* 


.18* 


.17* 


8-Selling 


-.01 


-.04 


-.02 


-.05 


-.03 


.03 


.06 


.05 


9-Service 


-.14 


-.21** 


-.19* 


-.19* 


-.17* 


-.16* 


-.11 


.06 


10-Social 


.07 


.16* 


.14 


.14 


.17* 


.17* 


.16* 


.12 


11-Leadership 


.15 


.23** 


.22** 


.19* 


.23** 


.15 


.18* 


.15 


12-Physical 


-.01 


.07 


.03 


.06 


.05 


.07 


.10 


.04 
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16 PF 



SI S2 S3 S4 S5 S6 S7 S8 



A Warmth 


.12 


-.11 


-.17** 


-.14* 


-.11 


-.12* 


-.11 


-.15* 


B Intelligence 


.16* 


.29*** 


.26*** 


.25*** 


.30*** 


.24*** 


.15* 


.14* 


C Stability 


.07 


.07 


.05 


.06 


.08 


.10 


.12* 


.06 


E Dominance 


.16** 


-.09 


-.08 


-.12 


-.06 


-.05 


-.08 


-.12* 


F Impulsivity - 


.06 


-.06 


-.12* 


-.09 


-.05 


-.06 


-.02 


.01 


G Conformity 


.14* 


.12* 


.15* 


.13* 


.14* 


.13* 


.10 


.10 


H Boldness 


.02 


-.05 


-.08 


-.10 


-.01 


-.05 


-.04 


-.07 


I Sensivity 


.02 


.03 


-.06 


-.04 


-.03 


-.04 


-.03 


-.01 


L Suspicious 


.10 


-.07 


-.05 


-.08 


-.07 


-.02 


-.07 


-.06 


M Imagination - 


.02 


.10 


.03 


.03 


.04 


-.01 


-.02 


-.01 


N Shrewdness 


.07 


.08 


.11 


.11 


.12* 


.08 


.10 


07 


0 Insecurity 


.01 


-.04 


-.06 


-.05 


-.06 


-.02 


-.07 


-.03 


QlRadicalism - 


.05 


.03 


-.04 


-.01 


.00 


-.01 


-.03 


-.04 


Q2Suf f iciency 


.05 


.10 


.11 


.05 


.08 


.06 


.00 


.02 


QBDiscipline 


.09 


.04 


.02 


.02 


.09 


.09 


.05 


.00 


Q4Tension 


.11 


-.15* 


-.13* 


-.14* 


-.19** 


-.14* 


-.17** 


-.10 



^Sample sizes are: General Aptitude Test Battery (GATE; n = 150), United 
States Employment Service Interest Inventory (USES-Il; n - 155), Sixteen 
Pfcisionality Factor Questionnaire (16 PF; n = 253 ). 

*P < .05; **£ < .01; ***£ < .001 (2-tailed). 
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Finally, with a few exceptions, WPP scales are essen- 
tially independent of self-reported personality charac- 
teristics. The most notable exception is factor 
B-Intelligence ; the consistently positive correlations with 
rated work behavior are supportive of the relationships 
obtained for GATB scales G, V, and N. There is evidence 
that clients who describe themselves as somewhat reserved 
(A-), more conforming (G+), and le&s tense (Q4-) are rated 
slightly higher on most WPP scales. However, the rela- 
tionships are of very small magnitude and thus of theoreti- 
cal interest only. 

The first analysis of predictive validity of the WPP 
involved comparisons of five service outcome groups: 1) 
clients who completed vocational training programs (n = 61); 

2) clients who completed evaluation or medical programs, but 
did not go on immediately to vocational training (n » 22); 

3) clients who dropped out of the center for various reasons 
(n = 60); 4) clients who were judged to be non-feasible (n = 
30); and 5) clients who were discharged for disciplinary 
infractions (n = 8). While the distinctions among the five 
groups are unambiguous, it is much less clear how accurately 
group membership reflects the criterion of concern, i.e. , 
mature and appropriate work behavior. 

Nevertheless, careful examination of the mean WPP 
scores for the five outcome groups suggests that substantial 
relationships exist, and that the direction of the rela- 
tionships generally supports the validity of the WPP as a 
measure of clients' work potential (see Table 5). 
Specifically, clients who subsequently completed their voca- 
tional training programs were rated higher on all eight WPP 
scales during their initial work evaluation sequence than 
were clients who completed only evaluation or medical 
programs, clients who left the center, and clients who were 
judged non-feasible for futher vocational services. 
(Although the small number of clients who were given 
disciplinary discharges received the highest average ratings 
on seven WPP scales, it is difficult to attribute any 
meaning to this finding.) These generally favorable results 
are further strengthened by the similarity of the five out- 
come groups on sex, age, education, intelligence, and major 
disability. 

The second analysis of the predictive validity of the 
WPP was based on data for the 61 clients who completed v -na- 
tional training programs. Clients completed training i > :2 
different vocational areas, but more than half were in just 
four training areas: sales clerk, laundry, file 
clerk/receptionist, and custodial. Examples of other voca- 
tional training areas represented are small engine repair. 
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Table 5 







WPP 


Scores for 


Five 


Service 


Outcome 


Groups^ 






















WPP 


Scales 










Group 


N 
















O / 


CA 


1) 


Completed 

Vocational 

Training 


61 


M 

SD 


3.33 

0 62 


2.87 
0 .70 


3.01 
0.73 


3.13 
0 . 64 


2.87 
0 . 80 


3.12 
0 . 82 

W • U flat 


3.20 
0 .68 


3.34 
0 64 


2) 


Completed 
Evaluation 
or Medical 


22 


M 
SD 


3.09 
0.69 


2. 58 
0.94 


2.69 
0.91 


2.77 
0.88 


2 . 47 
0.98 


0.89 


0.72 


0.84 


3) 


Dropout 


60 


M 
SD 


3.21 
0.61 


2.77 
0.75 


2.88 
0.76 


2.92 
0.67 


2.71 
0.86 


2.99 
0.83 


2.91 
0.76 


3.18 
0.72 


4) 


Non-Feasible 


30 


M 

SD 


3.08 
0.66 


2.67 
0.80 


2.78 
0.88 


2.86 
0.77 


2.54 
0.84 


2,83 
0.98 


2.73 
0.74 


2.90 
0.88 


5) 


Disciplinary 
Discharge 


8 


M 

SD 


3.56 
0.32 


3.17 
0.84 


3.16 
0.72 


3.22 
0.67 


2.98 
0.12 


2.88 
0.85 


3.23 
0.90 


3.44 
0.62 



^Comparisons between clien*-.s who completed vocational training (group 1) and 
clients in groups 2, 3, and 4 combined yielded significant t-statistics for WPP 
scales S4 (£ < .02), S7 (£ < .01), and S8 (£ < .03). 
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upholstery, food service, and data processing. Reflecting 
the heterogeneity of vocational training areas, program 
length ranged from 8 weeks to 52 weeks, with the typical 
length between 16 and 32 weeks. At the point of program 
completion, vocational instructors rated each graduate on 
(a) 12 general vocational competencies, e.g. , works with 
others, follows instructions, and accepts responsibility, 
and (b) from 20 to 40 job competencies specific to each of 
the training areas. 

Because all specific job competency items were judged 
on a standard 4-point scale of skill acquisition, an average 
specific job competency score could be calculated for each 
client in the sample. The 12 general vocational competen- 
cies were rated on a 2-point scale (acceptable or needs 
improvement); an average score was also calculated for each 
subject. Correlations between eight WPP scales and average 
general and specific competencies are listed in Table 6. 

Four of the eight WPP scales were statistically signi- 
ficant predictors of general vocational competence. 
Considering the heterogeneity of the client sample and the 
variety of vocational training areas clients graduated from, 
these validity results are impressive. The absence of pre- 
dictive relationships between WPP scales and specific job 
competency is also consistent with the design of the WPP; 
the instrument was not intended to assess specific job skill 
acquisition, but rather to measure general work personali+-y 
attributes that are essential to successful adjustment in 
all vocational areas. It is important to note that higher 
general and specific vocational competency ratings were 
achieved by clients who had previously described themselves 
as more secure (0-), r = .39 < .005) and r = -.28 (£ < 
.05), respectively, and as less tense (Q4-), r = -.44 (£ < 
.001) and r = -.29 (£ < .05). 

Summary 

1, The WPP is a comprehensive, behaviorally-oriented work 
assessment instrument that is scored on 11 rational 
scales and five factor scales. The five factor scales 
are: Task Orientation, Social Skills, Work Motivation, 
Work Conformance, and Personal Presentation. The 
rational and factor scales provide diagnostic scores at 
two conceptual levels in the hierarchy of observable 
work behaviors. 

2. Internal consistency reliabilities for the 16 WPP sca- 
les are mostly in the .80s and low .90s; inter-rater 
reliabilities are typically in the .40s, .50s, and 
.60s; re-rater reliabilities are mainly in the .70s, 
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Table 6 



WPP Correlations with General 
and Specific Vocational Competencies^ 



Vocational WPP Scales 

Competencies ^ 81 " S2 S3 S4 S5 S6 S7 S3 

General .33** .17 .24 .29* .19 .20 .32** .34** 

Specific -.04 -.08 -.09 -.06 -.03 -.07 -.03 .01 

^For clients who completed vocational training programs {n - 61) 

^General vocational competence is an average of 12 rated items; 
Specific job competence is an average of between 20 and 40 rated 
items developed for each training program. 

*£ < .05} **£ < .C2 (2-tailed) 



.80s, and .90s. The lower inter-rater agreement 
suggests that independent ratings from two or more 
observers should be averaged into composite scores for 
diagnostic purposes. 

3. Concurrent correlations with standard aptitude, 
interest, and personality measures revealed substantial 
relationships between WPP scales and cognitive ability, 
modest relationships with vocational interests, and 
virtual independence of the normal personality sphere. 
The WPP was predictive of successful service outcomes 
using two criteria of vocational adjustment, i.e., 
completion of vocational training programs and rated 
general competence during vocational training. 

4. In addition to average raw scores which provide 
criterion-referenced interpretation on the 4-point 
anchored format, WPP scale scores can be translated 
into percentile equivalents using the normative table 
in Appendix 2. The entire WPP scoring and reporting 
procedure could be programmed for microcomputer appli- 
cation by practitioners with the requisite facilities 
and resources. 



22 

23 

ERIC 



References 

Bolton, B. (1970). The Revised Scale of Employability : An 
application of Taylor's rating scale construction tech- 
nique. Experimental Publication S /stem, Issue No. 1, 
Ms. No. 261-346. 

Bolton, B. (1985a). Measurement in rehabilitation. In E. 
Pan, S. Newman, T. Backer, & c. Vash (Eds.), Annual 
review of rehabilitation (vol. 4), (pp. 115-144). New 
York: Springer. 

Bolton, B. (1985b). Minnesota Satisf actoriness Scales. In 
D. J. Keyser & R. c. Sweetland (Eds.), Test critiques: 
Volume 4 (pp. 434-439). Kansas City, MO: Test 
Corporation of America. 

Crites, J. (1976). A comprehensive model of career develop- 
ment in early adulthood. Journal of Vocational 
Behavior , 9, 105-118. ' ~ 

Dunn, D. J. (1973). Situational a ssessm ent: Models for the 
future . University of Wisconsin-Stout, Department of 
Rehabilitation & Manpower Services, Research and 
Training Center, Menomonie, WI . 

Gellman, W. (1953). Components of vocational adjustment. 
Person nel & Guidance Journal , 31, 536-539. 

Gibson, D. L. , Weiss, D. J., Dawis, R. v., & Lofquist, L. H. 
(1970). M anual for the Minnesota Satisf actoriness 
Scales (Minnesota Studies in Vocational Rehabilitation: 
27). Minneapolis: University of Minnesota, Vocational 
Psychology Research. 

Greenspan, S., & Shoultz, B. (1981). Why mentally retarded 
adults lose their jobs: Social competence as a factor 
in work adjustment. Applied Research in Mental 
Retardation , 2, 23-38. 

Hoffman, P. R. (1972). Work evaluation: An overview. In 
J. G. Cull & R. E. Hardy (Eds.), Vocational rehabili - 
tat ion? ^'roJession and process . Springfield, IL: 
Charles C Thomas, 188-211. 

Kolstoe, 0. (1961). An examination of some characteristics 
disciminating between employed and not-employed men- 
tally reta^ ^d adults. American Journal of Mental 
Deficiency , b6, 472-482. 

Lewinsohn, P., & Graf, M. (1973). A follow-up study of per- 



23 



30 



sons referred for vocational rehabilitation who have 
suffered from brain injury. Journal of Consulting 
Psychology , 1, 57-62. 

Marr, J., & Roessler, R. (1986), Behavior management in 
work settings. Richard J. Baker Memorial Monograph 
Series. Vocationax Evaluation Work Adjustment 
Association , 2 . 

Getting, G. , & Miller, C. (1977). Work and the disadvan- 
taged: The work adjustment hierarchy. Personnel and 
Guidance Journal , 56, 29-35. 

Passini, F. , & Norma, W. (1966). A universal conception of 
personality structure. Journal of Personality and 
Social Psychology , 4, 44-49. 

Roessler, R. , & Bolton, B. (1983). Assessment and enhan- 
cement of functional vocational capabilities: A five 
year research strategy. Richard J. Baker Memorial 
Monograph Series. Vocational Evaluation and Work 
Adjustment Association , 1. 

Selz, N. , Jones, J., & Ashley, W. (19£0), Functional cap a- 
cities for adapt ing to the world of work . National 
Center for Research in Vocational Education, Ohio State 
University, Columbus, OH. 



Appendix 1 



Instructions for the WPP Floppy Disk^ 

1. The Work Personality Profile (WPP) is a 58-item work 
behavior rating instrument for use in evaluation and 
employment settings, 

2. The 58 work behavior items are completed by an evaluator 
or supervisor using a standard 4-point rating format. 

3. The WPP Report calculates scale scores and percentile 
equivalents for 11 primary and 5 secondary work behavior 
scales and lists critical employability deficits. 

4. The 58 WPP items appear on the screen in blocks of 10 
items with the standard rating format, 

5. To activate the Work Personality Profile: 

a. Place the DOS diskette for your machine in drive A 
and turn on the power switches for the display, base 
unit and printer, 

b. Follow the standard procedures described in your 
operations manual to reach the A> prompt, 

c. Place the WPP diskette in drive B, 

d. Type the following command: 

Copy Command. Com B: 

e. Press the ENTER key. 

f. Remove the DOS diskette and place the WPP diskette 
in drive A. 

g. Type PERCENT and press the ENTER key to reach the 
initial input screen, and follow the instructions on 
the screen to enter the 58 scores and generate a 
printed WPP Report. 



^The WPP was programmed for microcomputer by Panl M. Kuroda 
of the Arkansas Research and Trainina Center in Vocational 
Rehabilitation. 
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Appendix 2 
Scoring Key for WPP Scales^ 
11 Rationally Derived Scales 



51 Acceptance of work role 

52 Ability to profit from 
instruction or correction 

53 Work persistence 

54 Work tolerance 
35 Amount of supervision required 

56 Extent trainee seeks 
assistance from supervisor 

57 Degree of comfort or anxiety 
with supervisor 

58 Appropriateness of personal 
relations with supervisor 

59 Teamwork 

510 Ability to socialize with 
co-workers 

511 Social communication skills 



# of 
Items 

10 
6 

4 

5 
6 
3 

4 

3 

6 

5 



Item Numbers 



1,12,13,24,25,36,37,46, 
53,58 

2,14,26,38,47,54 



3,15,27,39 
4,16,28,40,48 
5,17,29,41,49,55 
6,18,30 

7,19,31,42 

8,20,32 

9,21,33,43,50,56 
10,22,34,44,51 

11,23,35,45,52,57 



5 Factor Analytic Scales 
Fl Task orientation 

F2 Social skills 

F3 Work motivation 
F4 Work conformance 
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12 

8 
9 



2,3,5,14,17,18,26,27,28 
29,30,38,39,40,41,42,47 
48,49,54,55 

9,10,22,23,34,35,43,44, 
46,50,51,52 

4,12,13,15,16,21,33,56 

11,19,20,24,36,45,53,57 

58 



F5 Personal presentation 



8 



1,6,7,8,25,31,32,37 
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Appendix 3 
Percentile Conversions for WPP Scales^* ^ 



Percentile Scores 



Scale 


1 


10 


20 


30 


40 


50 


60 


70 


80 


90 


99 


SI 


1 .00 


2 .35 


2.76 


2.92 


3.08 


3.19 


3.38 


3.50 


3.60 


3.79 


4.00 


S2 


1 . 00 


2 . 17 


2.57 


2.80 


2.87 


2.94 


3.00 


3.20 


3.38 


3.82 


4.00 


S3 


1.00 


1.82 


2.18 


2.48 


2.70 


2.83 


2. 95 


3.15 


3.40 


3.63 


4.00 


S4 


1.00 


2.00 


2.42 


2.76 


2.81 


2.92 


3.04 


3.17 


3.40 


3.70 


4.00 


S5 


1.00 


1.65 


2.02 


2.39 


2.64 


2.83 


2.93 


3.15 


3.37 


3.65 


4.00 


S6 


1.00 


1. 80 


2.25 


2.60 


2.70 


2.80 


2. 90 


2.99 


3.28 


3.65 


4.00 


S7 


1.00 


2.18 


2.40 


2.70 


2.79 


2.88 


2.97 


3.11 


3.35 


3.59 


4.00 


S8 


1. 00 


2. 00 


2.53 


2.68 


2.78 


2.88 


2.98 


3.29 


3.59 


3.78 


4.00 


S9 


l.CO 


2. 00 


2.40 


2.67 


2.84 


2.90 


2.95 


3.00 


3.21 


3.55 


4.00 


SIO 


1.00 


1.31 


1.S6 


2 .12 


2-47 


2 78 




J . u / 


"J 01 
J • Z± 




A t\t\ 

4.00 


Sll 


1.00 


1.92 


2.23 


2.48 


2.66 


2. 82 


2.90 


2.99 


3.22 


3.50 


4.00 


I 


1.00 


1.95 


2.41 


2.65 


.276 


2.94 


3.04 


3.19 


3.35 


3.62 


4.00 


II 


1.00 


1. 71 


2.22 


2.41 


2.66 


2.90 


2.98 


3.11 


3.26 


3.47 


4.00 


III 


1.00 


2.10 


2.68 


2.87 


2.97 


3.14 


3.27 


3.46 


3.62 


3.87 


4.00 


IV 


1.00 


1.95 


2.55 


2.77 


2.93 


3.12 


3.22 


3.33 


3.46 


3.66 


4.00 


V 


l.uO 


2.39 


2.63 


2.87 


2.93 


3.04 


3.17 


3.32 


3.49 


3.72 


4.00 




1 


10 


20 


30 


40 


50 


60 


70 


80 


90 


99 



Percentile Scores 



apor the normative sample of 243 clients in work evaluation programs 
(see text for description). 

DTo determine the decile (1,10,20...) score, locate the closest raw 
scale score (average of rated items keyed on the scale) in the body 
of the table and look up or down the column to the decile equivalent. 
Percentile scores may be calculated by interpolating the raw score 
intervals using standard procedures. 
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Appendix 4 
Scoring Instructions 

Scale Scores 

To calculate the 16 scale scores for the Profile Report, use 
the following procedures: 

1, List the rating given for each item in the scale. 

2, Add the rating scores together to generate a total scale 
score. 

3. Divide the total scale score by the number of items 
rated; delete any items left blank or marked with an "X" . 

4. The resulting score, ranging from 1.00 to 4.00, is the 
average for that scale; enter that average on the Profile 
Report. 

Study the following example which uses the data reported in 
the sample WPP in Appendix 3. 

Average 
Total - # of Scale 
WPP Scales, Items, and Sample Ratings Score . Items Score 

51 Acceptance of work role 28 9 3.11 
Items 1,12,13,24,25,36,37,46,53,58 

Sample 4, 3, 2, 3, 4, 3, 4, 4, X, 1 
Ratings 

52 Ability to profit from instruction 17 6 2.83 
or correction 

Items 2,14,26,38,47,54 
Sample 4, 3, 2, 2, 3, 4 
Ratings 

53 Work Persistence 13 5 2.60 
Items 3,15,27,39 

Sample 4, 2, 3, 1 
Ratings 

54 Work tolerance 13 5 2.60 
Items 4,16,28,40,48 

Sample 2, 3, 3, 3, 2 
Ratings 

55 Amount of supervision required 16 6 2,67 
Items 5,17,29,41,49,55 

Sample 3, 3, 3, 2, 3, 2 
Ratings 
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Average 
Total - # of Scale 
WPP Scales, Items, and Sample Ratings Score . Items Score 



56 Extent trainee seeks assistance 4 3 1.33 
from supervisor 

Items 6,lfl,30 
Sample 2, 1, 1 
Ratings 

57 Degree of comfort or anxiety 17 4 2.75 
with supervisor 

Items 7,19,31,42 
Sample 4, 1, 2, 4 
Ratings 

58 Appropriateness of personal 10 3 3.33 
relations with supervisor 

Items 8,20,32 
Sample 4, 3, 3 
Ratings 



S9 Teamwork 11 5 2.20 

Items 9,21,33,43,50,56 
Sample 3, 2, 2, 2, 2, X 
Ratings 

SlO Ability to socialize with 9 4 2.25 

co-workers 
Items 10,22,34,44,51 
Sample 4, 1, 2, X, 2 
Ratings 



Sll Social communication skills 11 6 1.83 

Items 11,23,35,45,52,57 
Sample 1, 2, 2, 3, 2, 1 
Ratings 

Fl Task orientation 55 21 2.62 

Items 2,3,5,14,17,18,26,27,28,29, 
Sample 4,4,3, 3, 3, 1, 2, 3, 3, 3, 
Ratings 

Items 30,38,39,40,41,42,47,48,49,54,55 
Sample 1, 2, 1, 3, 2, 4, 3, 2, 3, 3, 2 
Ratings 

F2 Social skills 26 11 2.26 

Items 9,10,22,23,34,35,43,44, 
Sample 3, 4, 1, 2, 2, 2, 2, X, 
Ratings 

Items 46,50,51,52 
Sample 4, 2, 2, 2 
Ratings 
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WPP Scales, Items, and Sample Ratings 

P3 Work motivation 

Items 4,12,13,15,16,21,33,56 

Sample 2, 3, 2, 2, 3, 2, 2» X 

Ratings 

F4 Work conformance 

Items 11,19,20,24,36,45,53,57,58 

Sample 1, 1, 3, 3, 3, 3, X, 1, 1 

Ratings 

F5 Personal presentation 
Items 1,6,7,8,25,31,32,37 
Sample 4,2,4,4, 4, 2, 3, 4 
Ratings 



Total 
Score 

16 



16 
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# of 
Items 



8 



8 



Average 
Scale 
Score 

2.29 



2.00 



3.38 
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Percentile Equiv a lents 

Use Appendix 2 to convert average scale scores to percentile 
ranks. An approximation of the percentile equivalent should 
suffice in most cases. For example, the evaluee's score on 
scale SI is 3.11, a score falling between the 40th %ile and 50th 
%ile. The range of corresponding raw scores is 3.08 for the 
40th %ile and 3.19 for the 50th %ile. Since 3.11 is approxima- 
tely one-third of the way between these two scores, its percen- 
tile equivalent falls about one-third of the way between the 
40th %ile and 50th %ile, or the 43rd %ile. 

The evaluee's score on S2 is 2.83, about halfway between the 
30th %ile and 40th %ile which correspond to raw scores of 2.80 
and 2.87, respectively. Therefore, 2.83 falls at approximately 
the 34th %ile of the normative sample. 

Standard interpolation procedures can be used to calculate 
exact percentile equivalents. A formula for this conversion is 
available in any introductory statistics textbook. 
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Ulork Psrsonolity Profile^ 



Pleosc describe the client's observed uuork performonce by using the hve options listed belouu to complete 
the 58 behoviorol items. 

^ fl definite strength, on employobility osset 

^ Rdequote performonce. not o porticulor strength 

^ Performonce inconsistent, potentiolly on employobility problem 

Q R problem oreo. uuill definitely limit the person's chonce for employment 

^ No opportunity to obsery/e the behovior 



CRmI 


lost 






Middle 




floter 






1 1 Dote 

1 1 





w 


\V 


(7) 


\U 




1. 


SuFFicientlu oleit ond oujQre 








(T) 
\U 




2. 


Leorns ncuu ossionments ouicklu 


w 


(7) 


(7) 


(T) 


(7) 


3. 


UJoi1<s stcodilu durino entire ujork period. 
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(7\ 
\D 
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Rccftots chonofts in tuorU ossionments 


t7\ 


W 


(7i 


(7^ 


(7) 


5. 


Needs virtuoilu no direct suoervlsion 


t7\ 


(7\ 
kV 


w 


(7\ 


(7) 


6. 


Reouests helo in on ooorooriote foshion 


W 




(7) 




(7) 


7. 


Roorooches suoervisoru oersonnel ujith conRdence 




\V 


(7) 


\U 


(7) 


8. 


Is Qoorooriotelu Priendlu mith suoervisor 






(7 


(7\ 


(7) 


9. 


Shoujs Dride in orouo effort 


• 


© 


© 


o 


© 


10. 


ShouJs interest in ujhot others ore doing 


© 


© 


© 


• 


© 


11. 


expresses likes and dislikes opproprioteli^ 


0 


• 


© 


o 


0 


12. 


Initiates ujork-reloted activities on time 


© 


© 


• 


o 


© 


13. 


Accepts ujork assignments and instructions from supervisor 






ujithout arguing 


© 


• 


© 


o 


0 


14. 


Improves performance ujhen shoujn houj 


© 


© 


• 


o 


0 


15. 


UJorlfs at routine jobs uuithout resistance 


© 


• 


© 


o 


0 


16. 


Expresses uuillingrtess to try neiu assignments 


© 


• 


© 


o 


0 


17. 


Carries out assigned tasks ujithout prompting 


© 


© 


© 


• 


© 


18. 


Rsks for further instructions if task is not clear 


© 


© 


© 


• 


0 


19. 


fkcepts correction luithout becomir>g upset 


© 


• 


© 


o 


0 


20. 


Discusses personol problems ojlth supervisor onlv if ujor^-reloted. 


© 


© 


• 


o 


© 


21. 


Rccepts assignment to group tasks 


© 


© 


© 


• 


© 


22. 


Seeks out co-ujorkers to be friends 


© 


© 


• 


o 


© 


23. 


Responds ujhen others initiate conversation 
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© 


• 


© 


o 


© 


24. Conforms to rules and regulations 


• 


© 


© 


© 


© 


25. Molntoins sotisfdctorv pe^^nol hi^ieoe habits 


© 


© 


• 


© 


© 


26. Changes ujort< methods uuhen instructed to do so 


© 


• 


© 




© 


27. Pogs attention to details ujhile ujorkiog 


© 


• 


© 




© 


28. Maintains productivity despite change in routine 


© 


• 


© 




© 


29. Recognizes oiun mistokes 


© 


© 


© 


• 


© 


30. flsks for help uuhen having difficulty uuith tasks 


© 


© 


• 


o 


© 


31. Comfortoble ujith supen/isor 


© 


• 


© 


o 


© 


32. Gets along ujith staff 


© 


© 


• 




© 


33. UJorks comfortably in group tasks 


© 


© 


• 


© 


© 


34. Appears comfortable in social Interactions 


© 


© 


• 


o 


© 


35. Initiates conversations uuith others 


© 


• 


© 


o 


© 


36. Displays good Judgment In use of obscenities and vulgarities 


• 


© 


© 


o 


© 


37. Arrives appropriately dressed for luork 


© 


© 


• 


o 


© 


38. AAalntoins Improved ujort< procedures after correction 


© 


© 


© 


• 


© 


39. Molntoins uuort< pace even If distractions occur 


© 


• 


© 


© 


© 


40. Performs satisfactorily in tasks that require variety and change 


© 


© 


• 




© 


41. Inltiotes action to correct o:ijn mistakes 


• 


© 


© 


© 


© 


42. PerformorKe remains stab'e in supen/isor's presence 


© 


© 


• 


o 


© 


43. Supportive o? others In group tasks 


© 


© 


© 


o 


• 


44. Joins social groups uuhen they are available 


© 


• 


© 


o 


© 


45. Listens uuhile other person speaks, ovoids interrupting 


• 


© 


© 




© 


46. expresses pleasure In accomplishment 


© 


• 


© 


© 


© 


47. listens to Instructions or corrections attentively 


© 


© 


• 


o 


© 


48. Moves From Job to Job easily 


© 


• 


© 


o 


© 


49. Needs less than average amount of supenrlsion 


© 


© 


• 


© 


© 


50. Offers assistance to co-uiort<ers uuhen appropriate 


© 


© 


• 




© 


51. sought out frequently by co-ujort<ers 


© 


© 


• 


© 


© 


52. expresses positive feelings, e.g.. praise, liking for others 


© 


© 


© 




• 


53. Displays good Judgment in playing practical Jokes or "horsing around 


© 


• 


© 


o 


© 


54. Tronsfers previously learned skills to neiu task 


© 


© 


• 


© 


© 


55. Handles problems uuith only occasional help 


© 


© 


© 


© 


• 


56. Assumes assigned roie in gioup tasks 


© 


© 


© 


• 


© 


57. expresses negative feelings appropriately, e.g.. anger, fear, sodness 


© 


© 


© 


• 


© 


58. Controls temper 
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lUorii Personolitv ProRle 



C du c odofl 



Disobilitv 



^nployobMtv CmplovQbWlSv 
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€quivQi«nt 
% 

43 
34 

31 



25 



41 



35 



71 



15_ 
34 



10 



29 



27 



13 



1 1 



73 



51 Acceptance of \Jx>tU role 

52 ffclllty to profit from Instruction 
or correction 

53 LUc K persistence 

54 UUortf toieronce 

55 Rmount of supervision required 

56 extent trainee seeks ossistartce from 
supervisor 

57 Degree of comfort or anxiety ujith 
supervisor 

58 Rppropriateness of personal relations 
uuith supen/isor 

59 TeamiJLK}i4< 

510 Rbiiitv to socialize ujith co-ULX>rkers 

51 1 Social communication skills 



F1 Task orientation 

F2 Social skills 

n Uiork motivotlon 

M UJork conformance 

F5 PersorKii presentotion 



CrICicQl env>iovobllitv deficits. i.e.. behaviors rated "1" or "2" 



"1" Probkmoreos 

( i 1 ) expresses likes & dislikes i noppropriotcly. 
(18) Foils to osk for necessory nstnjctions. 19. 
22. 30. 39 56, 58 



"2" Problem anos 

(4) Resists chonges in mork ossignnnents. 

(6) Requests help inapproprioteiy, 13. 15. 21. 23. 26, 
31. 33, 34, 35, 38, 41, 43, 48, 50, 51, 52 55 
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